AD620176  * 


GRADUATE  SCHOOL  of  INDUSTRIAL  ADMINISTRATION 


I 

i 


Management  Sciences  Research  Report  Mo.  49 


AN  EXTENSION  OF  THE  BOUND  ESCAUTION  METHOD 
FOR  INTEGER  PROGRAMMING:  A  PSEUDO 
PRIMAL-DUAL  ALGORITHM  OF  THE  GOMORY 
ALL-INTEGER  VARIETY 

by 

Fred  Glover 


July,  1965 


MANAGEMENT  SCIENCES  RESEARCH  GROUP 
GRADUATE  SCHOOL  OF  INDUSTRIAL  ADMINISTRATION 
CARNEGIE  INSTIIUTE  OF  TECHNOLOGY 
PITTSBURGH,  PENNSYLVANIA  15213 


This  report  vas  prepared  as  part  of  the  activities  of  the  Management  Sciences 
Research  Group,  Carnegie  Institute  of  Technology,  (under  Contract  Nonr  760(24) 
NR  047-048  with  the  U.  S.  Office  of  Naval  Research).  Distribution  of  this 
document  is  unlimited.  Reproduction  of  this  paper  in  wiiole  or  in  part  is 
permitted  fcr  any  purpose  of  the  United  States  Government. 


ADSTRACT 


Tho  bound  eocalatlon  method  la  an  algoi'ltlm  for  bo1v1i\'  Integer  linear 
progi’wao  that  la  CI030I7  related  to  tho  all-integer  integer  prograrailng 
algorithm  dovolopcd  by  Ralph  Gomory.  In  tho  bound  eocalr.tlon  method  tho 
pivoting  procoso  la  dooomjjoaod  into  two  aeparato  atagea.  In  tho  fix’ct  atago 
the  problem  matrix  la  eubjectod  to  a  aerioa  of  nonoingular  Intogor  LIncor 
tranefomationa  (corroapondlng  to  integral  row  additlona  and  oubtractlona  jn 
tho  proW.em  tableau)  to  create  a  now  pi-oblcm  oxhibitlng  a  opacie.l  atru.cturo 
called  tho  bounding  Toinn.  The  recoiid  atage  then  operatec  on  tho  bounding  fonn 
to  obtain  lower  bounda  for  a  aubaet  of  tha  current  problem  varijabloa,  and  thie 
information  la  utilized  in  conjvnction  with  tho  auccocai^Toly  derived  pi-oblom 
matricoa  to  guarantee  convergence  to  tho  optimal  solution  for  tho  origlra^l 
problcaa  in  a  f  ini  to  nmnber  of  stops. 

Tho  extension  of  tho  bound  eGColation  metho<J  dovo loped  In  thio  paper 
is  still  moi'o  closely  allied  to  Gcnoiy’o  all-lntogor  algorithm,  end  indoed 
roay  alternately  be  regarded  ao  on  exbonoion  of  that  methc.d.  The  oxtunnicn 
arinoo  out  of  a  opoclal  case  in  >/iiich  tho  bounding  form  conelsts  of  a  sirglc 
column  vector.  V/ith  tho  bounding  fom  thus  rootrlctod,  tho  Gcjaory  aU -intogor 
n3gorl.tlun  may  be  regarded  as  an  appllcaticn  of  the  boimd  eocalntiai  n^rthod  to 
conotraints  that  ja&y  bo  weaker  than  thoso  in  tho  tableau,  tho  purpooo  of  the 
rostrlctod  application  being  to  obtain  a  oinglo-colur.ui  bounding  form  in  one 
Htop.  Thio  intorprotation  leado  to  the  conoidox’ation  of  "cnc-utop” 
t.ranofonnationa  that  ylold  a  bounding  form  without  employing  v/cakoned  conr.tr.«».lnV.'? 
Drawing  on  other  conaidoratlons  dnvolopod  in  the  piper,  tho  trnns'orT^vition 
we  select  results  fren  pivoting  •;«!  a  Ganory  Inequality  in  violation  of  the 


rule  that  malntolne  tho  tableau  dual  feaelble.  This  oholee  ie  aecoapanled 
bj  a  recovery  phase  In  which  dual  feaeiblUty  ie  once  again  restorodf 
allowing  coaiparioon  with  the  primal  method  of  R.  D.  loung.  The  ruloe 
governing  the  recovery  guarantoo  n  net  advance  toward  tho  optimal  oolution, 
thus  also  invoking  an  analogy  with  the  primal-dual  algorithm  of  ordinary 
linear  programning.  Other  variations  also  arising  out  of  the  results  of  the 
paper  are  briefly  diseussod  in  a  oonoluding  eeotioo. 


In  thlB  paper  an  extenalon  of  the  bound  oocalation  method  is  preeonted 
that  enabloe  the  cuatcoary  dual  foaelbllity  roqulnanont  in  the  Integer 
prograoiQlng  tabloau  to  bo  eynteiiuiticAlly  violated.  The  purpoee  of  this 
extension  is  to  enlarge  the  number  of  solution  otrategloa  at  our  disposal  for 
solving  integer  progronnlng  problcma.  At  this  atage  ve  do  not  know  a  gi^eat 
doal  atx)ut  matching  algorithms  to  specific  problems;  howovor,  the  efficiency 
of  the  exteiuslon  proposed  hero  In  solving  sane  of  tho  problenio  exrunincd 
oncouragoo  the  hope  that  It  may  find  useful  application  as  wo  gain  Increased 
knovrledgo  of  its  particular  etrangthe  and  woaknosoos  in  rclatloa  to  various 
problem  typos. 

The  general  course  of  the  presentation  In  this  paper  ivlH  be  ao  follows. 
A  description  cf  the  Intogor  programming  problem  and  tho  notation  to  bo  usod 
arc  given  In  Section  2.  Beginning  vilth  Section  3,  and  continuing  through  its 
soveral  subsections,  an  Informal  outline  of  the  bound  escalatlcn  method  Is 
prosontod,  highlighting  tho  concept  of  the  bounding  form  and  the  relation  of 
tho  bound  eecalation  method  to  Gomory's  all-lntoger  method.  The  Implications 
of  tho  similaritloo  and  contrast  a  bot\<ccn  the  two  methods,  ostabHshed 
within  tho  context  of  tho  single-constraint  bounding  foimi,  provlds  tho  basis 
for  the  cxtcFiOion  developed  In  the  following  section. 

Section  Ut  and  particularly  Section  5#  which  together  contain  tho 
basic  results  of  this  paper,  follow  a  more  formal  pattom.  Thoso  Ijitcre&tod 
chiefly  in  tho  rosulto  of  these  oectionr,  and  less  concerned  about  tho 
backgroitr.d  material,  may  skip  directly  frem  Section  2  to  Section  4  without 
sacrificing  the  ability  to  follow  the.  accempanying  thooroms  and  prf»of8. 

Exaiaple  problems  illustrating  tho  method  aro  solved  in  Section  6,  vli^.  u 
spsclal  variations  Implied  by  the  results  of  the  pwcodlng  soctiona  aro 
also  outlined. 
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2.  Not Ht Ion  and  Doocrlption  of  tho  Problem. 

Tho  integer  linear  progracning  problem  may  be  written 
(1)  Minimize  wb  -f  b 

o 

subject  to  wA  >  Oi  w  >  0  and  w  Integer, 
wliora  b^  is  a  ec^OLar,  b  lo  on  m  x  1  colusn  vector,  A  is  an  a  x  n  matrix, 

0  is  a  1  X  n  row  vector,  and  w  is  a  1  x  a  row  vector  of  variables.  We  assume 
that  A  has  the  fora  (A^,  I) ,  >d)ere  I  is  the  m  x  m  Identity  matrix,  and  that 
c  corroopjondlngly  has  the  form  (o°,  0),  where  0  denotes  the  1  x  a  zero  vector. 
Thus,  wA  >  c  is  composed  of  the  constraining  relations  wA^  ^  and 
wl  >  0,  so  that  tho  nonnegativity  conditions  on  w  are  Inolxided  in  the  gonoral 
matrix  inequality  wA  >  c. 

We  shall  additionally  assume  that  the  components  of  b,  A,,  and  c  are 

Intogore  (although  rational  nisnbors  are  penBisoiblo),  and  that  the  aufpnentod 

matrix  (-b,  A)  is  lexicographically  (lex)  negative  by  row,  thus  satisfyliig 

2 

tho  coniiitlcna  of  dual  feasibility. 

We  alternately  represent  problem  (1)  by  the  following  tobleau 


1.  A  nonr.oi'o  vector  is  said  to  bo  loxlccgraphlcally  (lox)  negntivo 
xjh.m  its  fii-nt  ronr.oro  cemponont  is  negative,  A  lex  positive  vec^.»'t*  io 
sijui'arly  defined. 

2.  Dual  feaolbiLity  la  satisfied  v/henever  b  >  0,  although  for  corkVGn.icnc«j 
v/a  shall  frequently  refer  to  dual  foaoiM-llty  as  synonymous  with  the  ir.o:.\3 
restrictive  conditi'^ns  iinponod  on  (-b.  A)  r.bovo,  Vto  chooso  to  deal  with 

(“b,  A)  rather  than  (b,  -A)  —  vhlch  must  then  bo  lox  TOsltivo  —  to  eotablirh 
notatloual  unifenaity  betwoen  the  present  paper  and  [3J,  where  thic  convention 
was  employed  to  pornlt  certain  relationships  involving  the  constraints  audaiwrlr.ed 
by  wA  >  c  to  be  glimpsed  more  readily. 
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We  doolfpuite  the  -  b  column  of  the  tableau  (including  b^)  ae  column  0^ 
and  the  firot  column  of  A  (including  c^)  an  column  1  of  the  tableau^  and  eo 
forth.  For  convonionce  In  referring  to  the  rowa  of  tho  tableau,  we  dooignate 
the  ith  row  hj 

*^2*  •••  '  ^'in^'  ^  ""  2,  ,  m, 

where  a^^  "  -  b^  and  a^j  donotos  the  ij^  element  of  the  A  matrix  for 

J  ^  Similarly,  \m  deoignato  tho  bottom  row  of  the  tableau  by  a^, 

"  ^*oo'  Sl»  ®o2* 

where  a  ^  b  and  a  .  “  c.  for  J  >  1, 
oo  o  Oj  j 

3.  ^  Outline  of  the  Bound  Escalation  Method. 

3.1.  Optimality  and  otrato/;lo  ob.icctiveo  .~~Wo  observe  that  If  tho  c 
vector  happons  to  be  nonpositivo,  an  optimal  eolution  to  problem  (l)  io 
iriacdiately  ^ivon  by  w  «  0.  For  then  wA  >  c  io  oatiafled,  and  aloo 
wb  +  b^  b^,  there  being  no  smollor  value  poonible  for  wb  +  b^  vihon 
b  ia  rannogativo  and  w  >  0.  Thua  our  objective  jji  oolvlng  problem  (l) 
will  be  to  obtain  'n  its  place  a  new  problem  oatiofying  the  following  four 
conditions:  (i)  an  optimal  integer  oolution  to  tho  original  problem  is 
Iminodilatoly  determined  by  opeclfying  an  optimal  oolution  to  tho  now  problem, 
(11)  tho  (-b,  a)  matrix  for  the  novr  problem  ie  lox  negative  by  row,  (ill)  tho 
c  vector  for  the  new  problem  ie  nonpositivo,  and  (iv)  tho  varlablco  of  tho 
now  problem  are  conotralned  to  bo  nonnogative  Intogoro  under  tho  ae  sumption 
that  the  original  variablea  are  ao  constrained. 

Aa  wo  have  ocen,  tho  loot  three  conditlona  aesure  that  an  optimal 
Doluticn  for  the  new  problem  will  be  obtained  by  ootting  q!11  variablon  equal 
to  zero.  Condition  (1)  then  aesuree  that  the  original  problem  is  thereby 


Bolvod 


u 


The  foregoing  of  cotireo  correaponda  to  one  of  the  usual  strategies  for 
solving  linear  programming  prohleos,  and  the  conditions  (iJ)  and  (ill)  are 
''ustouarlly  refezrod  to  as  the  conditions  of  dual  and  parimal  feaslbllltj, 
roepectivel/. 

To  croato  the  now  problem  of  the  dooired  fora,  the  bcund  eocalation 
mothed  operates  on  tho  tableau  of  the  original  problem  to  obtain  a  ouccosslon 
of  new  problems  each  satisfying  conditions  (i)^  and  (iv),  until 

evontually  a  problem  is  created  that  also  satisfies  condition  (ill).  Thus 
tho  tableaus  for  the  successlvo  problems  nay  bo  represented  in  the  oamo  form 
as  that  of  the  orlglnal«^  and  tho  final  tableau  is  obtained  when  the  o  vector 
is  driven  nonpoeltlvo.  The  solution  to  the  original  problem  is  then  given  by 
V  ■>  -  Cl  whoro  o’  denotes  the  last  m  ocaponents  of  the  final  c  vector  (tho 
portion  that  bog  on  as  tho  0  vector)  • 

As  we  ha>e  outlined  it  to  this  pointy  the  bound  sscalatio)!  method  follows 

the  uame  gonera].  pattern  as  tho  simplex  method  of  lins^ar  programming.  Hevovorf 

the  bound  oscalotlon  method  permits  only  integer  transfonnAticno  to  be  appltod 

to  the  tableau.  In  order  to  assure  that  each  of  the  new  variables  so  created 

nay  be  oxpresood  as  on  integer  linear  combination  of  the  original  variables 

2 

plus  on  Integer  conotont. 

Each  integer  transformation  corresponds  to  adding  integer  multiples 
of  a  row  a°  to  the  other  rows.  Those  row  operatl«'<no,  appropriately  rostrictod 
30  ao  to  maintaJn  the  ourrenv  problem  variables  nonnogative  and  tho  upper 
tableau  lox  nogutlvo,  are  first  applied  to  tho  (“b.  A)  matrix  to  evi-ate  the 
stinicture  called  tho  bounding  tom.  Thereupon,  positive  lower  bounds  are 

1.  It  is  not  nocoooary,  however,  that  the  euccessive  A  matrices  bo  of  the  fo\-m 
(A*.  I). 

2.  Tho  roscjmblanco  hero  to  Comory's  all-integer  method  Js  apparent,  and  will 
bo  elaborated  upon  ehortly. 
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dote 'mined  for  a  oubset  of  tSe  problem  VArinbD.OB,  end  the  bottem  row  in 
modified  in  ouch  a  manner  aa  to  advance  the  problem  toivard  ooiutlon.  Thuo, 
apeejf icolly,  the  bound  eecalatlon  method  conniota  of  two  ftltoxviatl*\'r  ota^oa 
that  may  bo  eurnmarizod  ao  foU.owoi 

1.  S'>.n r;o  1:  Ujo  row  opoxatlona  that  preoervo  lex  ne;;,itivity  in 
the  (-b,  A)  matrix  to  ci'oato  a  now  probloon  In  nonnegative  integer  varlablen 
oxlvlblting  a  atructuro  called  the  bounding  fom. 

2.  Stofre  2:  Operate  on  the  bounding  fom  to  obtain  pooitive  Jjitegor 

lowor  bounde  for  a  oubect  of  tho  problem  variabloo  (the  lower  bounde  for  the 

romlnlng  varlabloa  of  courea  being  zero).  Replace  the  c  vector  by  tho  vo'*,tor 

c  -  and  rcplaco  b^  by  b  +  >5b,  where  0  dono^ee  tho  vector  of  the  Inuicatod 

o  o 

lower  bounin, 

3.  Repeat  the  foregoing  prccooe  until  the  curi'ent  c  vector  V.ccmca 
nonpoeitivo,  whoroupon  an  optir^  eolutlcn  to  the  original  problem  In  given 
by  Dotting  w  equal  to  the  negative  of  tho  last  ra  coaponente  of  the  current 

c  vo^.tor  (or  a*’).^ 

3»2,  Th^  bo]indjjiC(;  fom. — Wo  now  coneidor  tho  etiucturo  that  provides 
tho  come  rot  one  for  the  nethed.  In  applying  tho  first  etage  of  the  bound 
oocalatlon  nwthod  we  doblre  to  create  a  tableau  which  upon  ouitable  jxjdexing 
may  be  partitioned  as  followa. 


-  b 

D 

Q 

‘■o 

d 

1.  Follodng  tho  criterion  ootabliohcd  by  Getoory,  to  innure  th{\t  t):o  c 
vdll  eventually  be  driven  nonpositivo  it  sufficoo  to  uno  anv'  rule  for  cver.Mm: 
a  bounding  fonn  that  will  ovontually  include  a  column  r  in  tho  bounding  fern 
atin'cture  for  which  has  not  otherwise  been  d/lvon  nonpositivo. 
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Here  D  io  a  p  x  p  equaro  matrix  with  poeitira  ontrios  along  the  main 
diagonal  and  nonpositive  entries  evorTwhore  elss.  Q  is  a  matrix  composed 
entirely  of  nonpooitive  ontrios,  and  d  is  a  p  component  row  vector  at  least 
one  of  whose  entries  is  positive.^  Under  those  conditiono  wo  refer  to  the 
special  structuie  of  0,  Q,  and  d  as  constituting  the  bounding  fom.  We  are 
unconcerned  with  the  portions  of  the  tableau  marked  with  an  aotorisk* 

When  d>0  (d/O),  the  assumption  that  the  problem  has  a  feasible 
solution  implies  that  the  inverse  of  0,  D  exists  and  consists  entirely  of 
nonnegative  conponente.  In  addition  it  may  bo  shown  that  the  nonnegative 
vector  D  ^d  gives  lower  bounds  for  the  first  p  eempononts  of  the  current  w 
(not  necessarily  the  oidglnal  w).  Any  fractional  components  of  nay 

of  eoxirse  be  roiinded  upward  to  the  next  highest  Integer  to  glvo  Integer  lower 
bounds  for  the  oloaonts  of  w. 

It  la  also  possible  to  obtain  lower  bound#  In  a  similar  fashion  when  d 
contains  negative  as  woU  as  pooitive  components,  though  such  considerations 
will  not  bo  pursued  here. 

Boginning  with  the  epeoified  lower  bounds,  the  bound  escalation  method 
continuoo  by  ar  elementary  prooese  of  incrementing  these  bounds  as  nocessary 
to  obtain  a  resulting  vector  of  lovrer  bounls  d*,  d*  >  0,  such  that 
d  -  d^D  <  0.  The  vector  d**  may  then  be  used  to  give  the  first  p  components 
of  w,  thus  enabling  the  ciirrent  o  voctor  to  bo  modified  as  described  in  Section 
3.1. 

For  the  purposes  of  the  paper  ve  shall  consider  only  the  caau  in  which 
0,  Q,  and  d  constitute  a  eingle  column  of  the  tableau.  In  this  inotanco, 
d  and  D  each  are  composed  of  a  single  positive  olmont,  and  d^  i*c3pectivoly, 
so  that  the  coi\L’traint  aoooolatod  with  this  column  may  bo  written 

1.  0,  Q,  and  d  need  not  appear  explicitly  in  tho  tableau,  but  may  bo  generated 
by  any  nonnogatlve  linear  combination  of  the  tabl.eau  coltmina  (excluding 
coluinn  0). 
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vhero  <  0  for  1  >2.  Tha  Integer  lower  bound  for  in  thie  caoa 

is  simply  <  >*  ^  so  may  be  inferred  inmediatoly  from  the  fact  that 

m 


2  '^i'^i  ^  hence 


The  opocial  fonn  of  the  constraint  (2)*  which  gives  the  eimpleet  instance 
of  the  bounding  fom  structure,  also  suppliee  a  condition  undor  which  row 
oporations  in  tlw  tableau  preoci’vo  nonnegativity  in  the  resulting  variables. 
Thus,  if  multiples  of  row  a^  alt)  added  to  the  other  rows,  thereby  replacing 
the  original  w^^  variable  by  a  now  w^,  we  can  bo  assured  that  the  new  w^  is 
nonnegative  if  the  tableau  exhibits  a  conotraint  such  as  (2).  Of  course,  this 
conclusion  also  holds  when  d^  <  0  provided  <  d^/d^  >  >  0  (d ^d^  >  -  1). 

Generally  speaking,  as  long  as  the  tableau  is  kept  lex  negative, 
negative  multiples  of  ("row  subtractions'’)  are  alT^rays  permissible  since 
the  constraint  ^  0  (implicitly  if  not  explicitly  asoooiatod  with  tho 
tableau)  is  thereby  changed  into  the  desired  fom.  On  the  other  haixl, 
positive  multiples  ("row  additions")  of  a^  are  loss  frequently  available 


since  they  cannot  be  Justified  by  reference  to  a  transformed  nonnegativity 

constraint.  In  splto  of  this,  row  additions  are  generally  desirable  whenever 

they  are  possible,  since  the  now  variables  so  defined  are  usually  smaller 

1  2 

than  those  they  replace.  This  may  bo  soen  from  the  fact  tliat  adding  a  to  a  , 
for  example,  corrosponds  to  replacing  Wj^  by  the  variablo  w^®  ■»  w^^  -  w^. 
Tho  contrary  conclusion  of  course  holds  concerning  row  siibtrai^lons. 


1.  V/o  use  the  notation  <  x  >  to  denote  the  least  integer  greater  than  or 
equal  to  x. 


d 


3 •3*  CrontAng  a  eln'^lo-conolrAAnt  bounding  fom.— \/o  now  consider 

how  to  manuTacture  a  constraint  of  the  form  of  (2)  from  at  leant  one  column 

of  the  tableau.  Wo  aeoume  that  a®  le  not  nil  nonpooltlTo  (dlorogarding  a^^) 

and  that  th<i  problem  hao  a  feaolblo  solution.  Tho  first  stop  io  then  to 

Bolect  a  column  r  (r  >  l)  of  tho  tableau  for  which  a  ("c)>0.  If  onlj 

*“  or  r 

one^of  tho  coraponents  of  that  column  lo  poaltivo  (other  than  then  the 
aoooclated  constraint 

21  A.  w.  >  o 

1  »  1  ^  i 


io  already  in  the  specified  form.  Otherwise,  we  nay  create  a  constraint 

eueli  ae  (2)  by  the  following  general  rule. 

(i)  Select  any  twu  poeitlvo  compononto  a  and  n  of  coliirm  r 

pr  qr 

(v»  4  ^  ^7  clioice  of  indexing,  asGurae  a^  is  lox  largos  than 


(ii)  Replace  by  -  a^,  dcsigTAtlng  the  reoaSting  row  as  tho 


q 

new  a^. 


(iii)  Repeat  tho  proceoe  until  only  one  pooitivo  x'oraains  for  i  >  1» 


At  each  application  of  tho  foregoing  process  the  tableau  in  aaintnlncKi 
lex  nogativo  and  one  of  tho  positive  coefficients  In  column  r  is  decreaood 
by  oubtr  ^Ing  one  of  tho  other  pooltlve  coefficients  from  it.  Thus,  it  is 
clear  that  ovontually  aiJL  but  one  of  tho  positive  will  become  nonpositlvo.'^ 


3. A.  Rolntion  to  tho  Genory  Incqualltloo. —  While  many  verlai  lons 
are  oubsunied  under  the  fcrogolng  genoral  rule,  a  variation  of  particular 

n  iit  leant  ono  a.  (1  >  l)  must  be  pooi.tivo  If  tho  problem  has  a  feasible 
solution. 

2«  M.  L.  Ballnoki  [1]  Imo  pointed  out  that  this  rule  eotabliahos  a  cloco 
corT'^spondonco  botv;oon  tho  first  stags  of  tho  bound  oscalntion  mothod  and  the 
oucLldcan  algorithm.  Of  course,  in  order  to  maintain  tho  nai  variabloa  nen- 
ncgatlvr;,  keep  tho  tableau  lox  nog^ativo,  and  create  a  bounding  form,  wo  eraploy 
speclallzatlcno  not  ordinarily  rcquiixd  of  the  euclidean  algorithra. 

3.  This  io  acourod  by  the  aooumptlon  that  the  eempononts  of  A  are  Intogor 
(or  rational). 
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Intoroot  loado  to  tho  oroation  of  a  oonatrAjjit  ouch  (2)  in  a  oinglo  stop. 
To  Bca  how  thia  vorlatlon  arlneo,  aupp>:jc,  for  axnmplo,  thi\t  lo  tho  lax 
largcat  row  in  tho  upper  tableau  having  a  ponitiva  coraponont  in  colicm  r. 

If  io  tho  largo ot  of  the  pooltivo  for  i  >  1»  than  ftj  bo  oubtractcd 
onca  from  oil  eucli  that  >0  (i>2)to  givu  a  conctraint  in  tha  form 
of  (2)  at  onca.  But  if  la  cniollor  than  oomo  of  tho  ot>»or 
work  inntoad  with  a  vreakor  conotralnt  in  which  a^^  io  Incrcaood  by  any  desired 
cjnou"L.  Cle  rly,  it  may  not  bo  noceccary  to  moko  the  Hjirgeot  poeitivo 
coofficiont  in  tho  weakened  conotralnt,  ojnee  poocibly  mora  thsn  a  unit 
multiple  of  a^  Biay  bo  oubtractocl  frera  the  othor  rowo. 

It  turns  oat  that,  whon  a^^  io  incroaoed  only  ao  much  aa  noccocaiy, 
and  cll  poiTiioslblo  ix)w  additiono  aro  cade  after  tho  required  eubtractiono, 
tho  ficmo  tranefoxTaation  of  tho  tableau  i*ooulto  ao  by  tho  uoual  pivoting 
procedure  of  Gcavoxir'o  aUL-lritogor  algox*it.hr»,^ 

llowovor,  it  lo  not  alvayo  dooirablo  to  tx*y  to  create  a  conotralnt  ouch 
ao  (2)  in  a  oingle  step,  particularly  if  a  oubotantially  xreahor  conotralnt 
than  tha  original  muot  bo  employed  in  oi\lor  to  do  oo,  Theix)foi*o,  diffownt 
motheda  have  boon  propoood  for  croating  a  olnglo-conotralnt  bounding  foi'ia 
than  the  ono  praooribed  by  tho  oll-ijitoger  algorithm,  Ono  ouch  jsothod, 
ouggootod  in  C3]»  provldoo  the  otax’bing  polixt  for  tha  oxtcnolon  dovolcprd  in 
thlo  papsr. 


3o5.  Dn<*k7rourd  of  t!\o  proponed  oxtnnoion, — ^Tho  method  to  which  vo 
have  roforcnco  connioto  olmply  of  carrying  out  all 

row  cporatlono  >dth  the  '  &nat  would  o^xJlivirily  bo  ur.rd  for  pivoting  vlth 
tho  eixnplax  method.  Specifically,  tho  largoot  posoibla  nultiplo  of  tho 


1.  The  canplcto  corroopoi>donco  follows  upon  altering  the  a”  row  by  dctormlning 
tho  lower  bound  for  tho  I'ooultlng  w^.  Moro  gonorally,  oolocting  tho  oiso  of 

corroopondo  to  dotoxrainlng  tho  paromotor  ^  in  tho  Gomory  inequality 


<  a 


10 


selected  row  lo  subtracted  from  each  of  the  other  roue,  eubject  to  the  tvo 
qualifications  that  the  upper  tableau  must  be  maintained  lex  ncgatlTo  and  no 
multiple  is  usod  tdilch  is  larger  than  that  required  to  make  the  of  the 
other  rows  nonpooitive.  Until  a  bounding  fonn  is  oreatedy  the  lex  smalloat 
row  ouch  that  a^  >  0  must  of  course  be  excluded  in  determining  the  row  for 
carrying  out  row  subtractions.  Thereafter^  all  row  additiono  that  preserve 
the  bounding  form  etruoture  are  carried  out,  and  the  a^  row  is  adjusted  in 
the  fashion  indicated  earlier. 

While  this  rule  can  be  shown  to  bo  more  effectiwe  than  the  approach 
of  the  all-integer  method  in  certain  eases,  it  is  also  frequently  loss 
effective,  prliearily  duo  to  the  fact  that  the  lex  negativity  requiroaont 
may  sovaraly  restrict  the  row  operations  available. 

In  this  paper  wo  present  a  method  that  uses  the  orjrM  row  choice  as 
the  preceding  rule,  but  which  ovorcemes  oemo  of  the  limitations  of  this  rule 
by  allowing  certain  of  the  rows  of  the  (-b.  A)  matzdx  to  boccne  lex  positive. 
In  fact,  the  method  bogina  procieely  ao  the  one  outlined  above  except  that 
the  lex  ordering  of  the  tableau  ia  ignored,  thue  making  it  possible  to  obtain 
a  bounding  form  on  each  step  idtbout  woakoning  any  of  the  pxv>blnm  constralnte. 
Ao  our  previous  discussion  Indicates,  the  resulting  transfonaation  of  the 
tableau  corresponds  to  one  obtained  from  pivoting  on  an  appropria&o  Gemory 
inequality,  although  this  inequality  will  be  proscribed  by  the  all-integer 
method  only  if  recourse  to  a  weakened  constraint  is  unnecessary  to  assure 
lex  negativity  in  the  upper  tableau. 

When  one  or  more  of  the  tableau  xx)w8  becesnes  lex  positive,  the  phase 
of  restoring  the  (-b.  A)  matrix  to  lex  negativity  is  immediately  iniated. 

At  the  conclusion  of  this  phase  the  a?  row  ia  lex  larger  than  at  any  previous 
point  when  (-b.  A)  was  lex  negative. 
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Thus,  In  brief,  our  oxteiiaion  of  the  bound  eocalAtion  method  may  bs 
regarded  as  a  "peeudo”  primal-dual  method  of  the  Conorj  varlot/f  exldbitlng 
certain  foaturoe  in  couimon  both  with  Ocnorj'a  all-integer  algorithm  and  with 
R*  0.  Toung'o  primal  method.^  V/«  now  turn  to  Bpooifjing  the  form  of  this 
exteneion  prooieoly, 

U,  Tho  Kxtension. 

To  facilitate  the  cnaulng  exposition  ve  introduce  the  foUo^dng 
additional  notation  anl  definitions.  Relative  to  a  specif iod  colir^n  r, 
define 

for  each  i,  1  <  i  <  n,  ouch  that  a^  7^  0,  Further,  lot  a*«  denote 

1  i 

tho  lex  largoat  a  ^  ouch  that  a  is  lex  negative  ond  >  0.  Kij)!*!!:^, 

lot  a^*  denote  tho  lax  aruOLloet  a^  such  that  a^  is  lox  positive  and  <  0, 
Then,  beginning  with  tho  tableau  of  Section  2,  the  intogor  pk'ogrrjLrlng 
method  proposed  in  this  eection  may  bo  described  as  follows. 

1.  If  a^  <  0  for  all  j  >  1,  an  optimal  oolution  to  tho  problcoa 
Is  given  by  w  «  -*3®,  where  denotes  the  laot  m  ccaponents  of  a® 
Obherwioe, 

2 

2.  Select  a  column  r  ouch  that  >0,  r  >  1,  Identify  tho 

row  a",  whoT.-o  a^-*^  io  defined  as  above,  and  let 

-0  o 

a  ■■  a  , 

forl>0,  1  a. 

3.  Update  tho  tableau  oo  that  "  a^  for  all  i  >  0,  K 

1,  Another  primal  integer  prog^’nnjnlng  algorithm  that  employe  Gcraoiy 
j.noquQlltl'to  is  duo  to  Doa-Icmel  and  Chamos  [2],  although  tho  Bon-Ieraol  - 
Cliamon  nothed  raqtdi*co  tho  solution  of  a  series  of  Intermcd.lato  au.flllnrjr 
j>x^blc:TOa, 

2.,  Wo  aocuue  that  tho  rui.e  of  choice  oporateo  within  tho  frataetfoik  specified 
by  Ganory  in  [4]. 
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tho  rooultljig  aro  all  lox  negative  for  i  >  If  return  to  1. 

OthervlnOf 

A*  Identlfj  the  row  o  ,  whoro  a  ^  le  defined  oe  above f  and  lot 

r  - 

>  a'  for  1  >0.  1  ^  t. 

5  a  Hotum  to  3. 

A  few  preliminary  oboez*vatlona  aivj  In  order.  Slnco  x+1  >  <x>  >  x 

for  any  x,  the  doflnltionn  a.  -  a.  -  <  a.  /a  >  a  and  a  -  a  _  >  0 

Ir  Ir  In  er  or  or  or 

together  Imply  that  0  >  a.  >  -  a^  (l^o)  after  each  application 

la  81* 

of  Stop  2.  Thio  menno  then  that  a  lo  the  only  pocitlvo  a.  for  1  >  0, 

and  <  >  ■  0  for  all  1  o.  Thus,  freo  the  diocuoolon  of  the 

conotralnt  (2)  In  Section  3.2,  the  now  variable  created  by  the  tranofomiatlcn 

defined  at  Stop  2  muet  be  nonnogatlvof  ard  of  couroo  Integer.  Tho  oamo 

ccncluslono  apply  ccnocmlng  Stop  replacing  o  by  v.  Tho  nonnogativity  of 

the  new  w^  «nd  may  alternately  bo  Juotiflod  by  oboorving  that  the 

tranofonratlone  are  alno  given  by  pivoting  on  the  Goaory  inequality 

^  ^  <  *or^^  whoro  ^  «  a^^  at  Stop  2  and  A  - 

o  yy 

at  Step  A.  Tho  oeloctod  pivot  i*owa,  a  and  a  x^opoctively,  nay  of  coui*3e 
bo  different  frem  thooe  opocified  by  the  ordinary  linear  progi'noralng  pivot 
ruloe  applied  with  reference  to  the  Conoiy  incqualitioo  . 

To  prove  that  the  method  convorgoa  ve  have  two  principal  objoctivee: 
firat,  to  ohow  that  whenever  eoao  a^  (i  >  1)  becoraoo  lex  pooltlve  when  tho 
tableau  is  updated  following  Step  2,  the  method  will  roetoro  the  upper  tableau 
to  lex  negativity  after  a  finite  number  of  iterations  of  Stop  A)  and  socoixlf 
to  ohow  that  the  a^  vector  will  be  lex  larger  on  each  visit  to  Step  1  than 


ou  tho  proviouo  vlnlt.  Th«  Conory  proof  of  convcrgcnco  for  tha  aU-lntc^or 
olgorlthflt  thon  applloa^  for  tho  appropriate  choice  of  r  at  Step  2|  and  our 
goal  will  bo  achieved. 

Wo  may  pouchly  outline  ths  otratoc;^  of  our  pioofe  ae  foDloue.  By  tho 
preceding  rorj-.rko,  each  time  Stop  U  io  vinitecl,  whether  via  tho  lout^i  from 
Stop  2  or  from  Stop  4  itoolf,  exactly  one  canjwnorf-  of  column  r  \dll  bo 
pooitive.  Tho  row  jji  which  thia  component  appoaro  will  bo  lax  nogative, 
hence  thio  row  corroopondo  to  tho  curront  a®.  Wo  vdll  undorLako  to  piT>Vv5 
that  two  other  Impoi'tant  charactoriotico  of  the  tableau  vriLll  aleo  be  preserved 
at  each  vleit  to  Stop  4i  (i)  all  a^*  for  lex  pooitivo  (i  >  1)  will  bo 
lox  larger  than  tho  curront  a®*,  and  (ii)  all  lex  pooitive  a^  will  bo  lax 
fvnallor  than  -  a*.  The  latter  fact,  depotuJont  upon  tho  former,  Implico  that 
-  a®  nmot  itoolf  bo  lox  docroaoli\2,  and  hence  that  the  number  of  itorationo 
at  Step  4  Duat  bo  finite. 

To  provo  aloo  that  a®  is  lex  larger  at  each  vloit  to  ^cp  1  than  on 
tho  pimvlouB  violt,  wo  will  in  fact  show  that  tho  rLiount  of  tho  lox  Incrcdoo 
in  aunt  alxmya  be  at  loaet  ae  largo  do  that  reeultljxj  frem  pivoting  witli 
tho  olmplox  method  wh*in  a^^  lo  the  oolected  pivot  olcsaont. 

5  >  Lr  Thoexv^’^,  nrjl  Proof o. 

In  what  follows  wo  intond  to  Idontify  a  with  a  or  a  ,  ae  appropriate, 
2 

and  to  identify  a  with  ono  of  tho  other  tableau  rowo.  Honco  doflno 
A  ^  a  -  <  *2r^^lr  ^  opociflod  r,  0  <  r  <  n,  such 

that  7^  0.  (whon  rofenlng  opeclflcally  to  the  mothod  it  will  of  couroo 
bo  truo  that  r  >  1  and  a^  >  0„)  Similarly,  wo  defino  ao  in  tho 
preceding  ocotion  for  each  i  ouch  that  0. 

l!  Thle  applicability  is  aoourod  by  tho  fact  that  a  ,  ^  0  each  tlJ.\o  tho 
tableau  le  updated  at  Stop  3. 


1  2 

Thoorcri  1,  Coiioider  vectors  a  and  a  such  that 

‘u  '*  ®>  "2r  ^  “•  '"‘®" 

(l)  a  "  le  lex  liirc«r  than  a®* 

if  and  only  Ifi 
—2 

(11)  a  lo  lex  noj^atlvo 


(ill'  *2^  <  0  arul  lo  lex  larger  thfin  q^. 


To  nlmplify  the  pi'oof  of  thio  thoerom  wo  otate  and  prove  the  fo]JLowlng 


thrno  ?,rirnmjin. 


1  2 

l/'jrin  Let  a  and  a  bo  given  as  in  Theorenj  1,  and  aaoumo  that 
«  0.  Then  (!'  la  true  if  and  only  if  (11)  le  tmo, 
i^*2L?£  si.  1«  To  prove  thlo  Dcr/fla  \ro  ohall  derive  an  oxprassiou 

for  that  wl).l  be  uued  again  In  provirg  Lesana  2.  By  dofinitlon 

*2J  '  “2J  -  <*2/V>‘u-  V  ■  Vzr  "**  V 

•'  oo  that  a^j  "  and  a^j  "  a^^.  Subotltuting 

for  02^  ard  In  tho  daflnltlon  of  02 j  ylelda 

“2j  "  V“2r  -  <  *2i-/®lr  >  “«*  *lr- 

By  the  definition  of  ^2^^,  ira  have 

^IJ*  "2r  "  *1J*  °2r  *"  ^  *^2x^1^  ^ 

and  thue  froa  tho  preceding  oxpanulon  of  we  obtain 

*^2^  "  *1/  *2r 

VUicn  a2y  ”  0,  tho  fact  that  a2j^  >  0  ImplloB  by  (3)  that 
(a'  a2j  “  0  if  and  only  if  A2J*  “  ^nd 

(b)  a2j  <  0  if  and  only  if  02^^  < 

“  -2  -2 
Lot  a2p  bo  the  flrot  ncnzeix)  cesnponont  of  a'.  Then  a  lo  lex  nogativo  If  ord 

only  if  a2p  <  0«  Aloo,  by  (a)  aborvo,  -  *1J*  J  ^  P» 

a^p^  '/  ^Ip* '  Thor*  fore,  a  *  la  lex  Inrgor  than  a*^  if  and  only  if 

V  But  then  by  (b)  wo  have  that  a^  lo  lex  lai’ger  than  a^<^ 

if  and  only  if  is  lex  negative,  which  is  what  we  desired  to  prove. 
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Remark  Lenria  1  hold  by  exactly  the  same  proof  when  a  is  alternately 

2  1 

defined  to  equal  a  -  Ka  ,  where  K  Is  any  number,  thus  Increasing  the 

generality  of  the  preceding  result.  Lemnas  2  and  3  below  likewise  hold  for 

>2 

this  weakened  definition  of  a  . 

1.  2 

I/rrmA  2«  Let  a  and  a  be  any  two  vectors  each  that  a^^,,  a^j,  7^  0 
'  jr*  0.  Thon  for  any  J,  0  <  j  £  n, 

V  "  V  V  “  'JJ*- 

Proof  of  Lcbttm  2.  Under  tha  assumption  that  a^^  ^  0,  wu  havo 
^2^*  "  ^2J^2r  definition.  Substituting  the  value  of  given  by 
equation  (3)  of  Lccma  1  into  thin  last  equation  gives 

(U  ijj*  -  -i-  aj,,(a2j*  -  «u*)/ Sj,. 

For  and  nonsero,  it  la  clear  from  (4)  that  a^j*  *»  Implios 

*2J*  ”  conversely  thnt  impHoo  a^^*  " 


X  2 

Lr;*iTtia  2«  Lot  a  and  a  bo  any  two  vc'^to^8  ouch  that  n^,  a^^  7^  0 
and  7^  0.  Assume,  moroovor,  that 

a^*  ir  lojc  larger  (eancallsr)  than  a^*  if  and  only  if  a^  le  lox  larger 

2 

(rmal^.or)  than  a  *. 

12  2 

Pixtof  of  Lor.mx  2«  Excluding  the  caoe  a  *  *  a  *  *  which  io 

iri'olovant  to  the  concluolon  of  tlia  Icrra,  it  io  aoeurod  by  Losiai  2  tlmt 
thcio  oxJ.ste  on  index  q  ouch  that  ®2q*  ^  ^2q*  ^  ^hq*' 

"  ^2J*  J  ^  equation  (4)  of  Ltmma  2;, 

^2r^^2r  ^  ^  Implioo  that  Uy*  <  if  and  only  if 

This  provuo  Lesm  3* 


Proof  of  Thoorem  1.  By  daflnition  a^^,  "  »2x»  “  *^2r^*lr  ^’Ir* 

liJnce  >  0  ond 

a-  <  0.  Tf  a..  *  0,  then  Theorem  1  ie  true  by  Lauraa  1,  while  If 

2r  "■  ^ 

<  0,  than  *2r^2r  ^  Theorom  1  is  true  by  L^ruAa  3. 

Rrmr3c%.  By  the  foregoing  proof  we  eee  that  Theorem  1  le  also  true  It  (il) 

-2  - 

ia  altered  to  road  “a  is  lex  negative  and  a^^,  "  0,"  thereby  increasing  the 


a^r/  <  <  *2r^®lr  ^  therefore  havo 
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generality  of  the  "only  If"  part  of  the  Theorem. 

1  2 

Theorem  2,  Let  a  and  a  be  given  aa  In  Theorem  1  and  aaaume 

1  2 

In  addition  that  a  and  a  are  both  lex  negative.  Then  If  (1) 

-2  -2  1 
la  true  and  a  la  lex  poaltlve,  it  followa  that  a  la  lex  ama!ler  than  -  a  . 

Moreover,  the  flrat  nonzero  component  of  -  a^  la  larger  than  the 

-2 

corresponding  component  of  a  . 


^  —2 
Proof  of  Thcortn  2.  Lot  a^p  ^  fJjrot  nonzero  component  of  a  • 

If  /  0  for  come  J  <  p,  then  tho  aonortlon  le  Innodintoly’  true, 

AIpo,  -  0  for  all  J  <  p  la  lmpoaoU)lo  since  then  a^j  •• 

2 

for  J  <  p  and  thuo  a  Is  lox  pooltlvo,  contrary  to  aoouzaptlon.  Thus 
Buppooo  that  la  aloo  tho  first  nct.\zero  component  of  a^  (where  It  Is  given 
that  a2p  lo  the  flrat  nonzero  component  of  a^).  Since  Is  lex  larger 

than  a  wo  have  >  <^2/^20*  -  *^2l/^lp' 

since  a^^p  <  0  and  >  0,  It  follows  that  <  ^  ^  ®2y/®lp  ^ 

end  ^2i'^^lr  '*  ^  ®2i/®lp  ^  definition  of  a^p* 

*2p  *  *2p  ■  *lp' 

®2p  <  *2p  -  (®2/‘lp 

fvnd  hence  ®2p  ^  ■*!?•  This  completes  the  proof. 


1  2 

Thootrrm  ^3.  Consider  two  vectors  n  azxl  a  ouch  that 

‘ir’*  “2r  <  ®-  »• 

Then 

(1)  a^*  is  lox  larger  than 
if  and  only  Ift 

(l;l)  a^  is  lox  negetivo 

O'l® 

(ill)  <  0  and  a^*  la  lex  larger  than  a^, 

2P 
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Remark  3;  The  conclusion  of  Lenma  1  continues  to  hold,  following  the  same 

1  2 

pattern  of  proof  as  above,  when  a  ,  a  and  condition  (1)  are  alternately 

given  as  In  Theorem  3.  Likewise,  the  conclusion  of  Theorem  2  holds  under 

1  2 

the  same  modifications  when  a  Is  lex  negative  and  a  Is  lex  positive. 

Remark  4:  When  the  assumption  *2r^*2r  ^  ®  replaced  by  •2r^*2r  ^  ^ 
in  Icinmfi  3»  ft  BlmUuir  arffjtmont  yield n  the  conclusion  that  a  ^  i.o  loix 
lar^ior  (mnaller)  than  If  atd  only  If  a^*  lu  lex  larger  (ornllor)  thi»n 

ft^. 

P;xof  of  Theorem  2*  By  roforenoo  to  the  procoding  iciT.:a'ko,  tho  proof 
of  Theorem  3  mirrors  that  of  Tho^jren  1. 

Thoerreg  4*  ^  ^  si  marlo  lox  poDltlvo  ro  a  rontilt  of 

tho  traneformatlon  dofir.cd  at  Step  2,  then  nil  a^  for  i  >  1  irfJLl 
boceme  lox  negatlvo  after  a  finite  number  of  Itcqrationo  of  Step  /», 
Proof  of  Theoron  Letting  a®  correepond  to  a^  aixl  to  st^  (1  s), 

it  follcuo  from  Thoorcaa  1  that  If  la  lox  positive  at  Step  2,  thon 
*ir  ^  Honcoy  after  updating  tho  tableau^  all  lox  poeitivo  (i  >  l) 
are  candidates  for  a  tho  fimt  time  Step  /»  le  vieited.  It  alno  follows 
from  Thoorem  1  that  a^*  is  lex  larger  than  tho  provlous  a°«-.  Lot  it  bo 
iauj.pined  tluit  Step  U  lo  broken  into  two  perts,  whore  flrct  ft^  is 
by  r’^  (>dhlch  we  continuo  to  refer  to  as  a7  inoteod  of  the  rjow  n^),  but  tho 
rcci^indei'  of  tho  updating  of  tho  tableau  is  doferrod,  ao  bcfo”o,  tmtil  Stop  3 
is  visited.  Thus,  by  the  above  remarks,  when  a  is  replaced  by  a  *=  -  a  , 

— Y 

but  boforo  any  of  the  root  of  the  tabloau  is  updated,  thon  a  natiofloo  tlie 
dofijiitlon  to  qualify  as  tho  now  a”.  Moreover,  by  definition*  a^  Is 
lox  groctor  than  a^*  (••  a^*)  for  all  lex  pooitivo  a^  (i  >  1,  i  v),  ThviS, 

aopoclatlng  sT  with  a^  and  aeeociatlng  the  lox  positive  a^  %riUi  a^  in 
Thocrem  3»  ve  see  that  each  ouch  a^  will  remain  lox  positive  lifter  Stop  4 
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only  If  Jo  lox  lorger  than  a^*.  On  tho  other  hand,  any  other  than 
the  cuA*ront  n*  that  Is  lox  negative  when  tho  tableau  le  updated  at  Stop  3 
will  rimaln  lex  nogative  after  eaoh  eubeoquont  Iteration  of  Stop  h,  Thle 
follows  from  tho  fact  that  <  0  for  all  ouch  a^,  and  henco  only  a 
nonpoiiJbivo  multiple  «  Of  th.  lox  nogatlvo  will  bo  oubtractsd 

fxxan  those  rwo  duo  to  tho  transf ormatlon  njjccJ^icd  at  Stop  4*  Consequently, 
on^rh  suboequent  iteration  of  Stop  4,  ae  >joll  ao  tho  first,  will  Ineuro  that 
(a)  <  0  for  all  lex  pooltivo  a^,  (b)  tho  current  corroopondo  by 

definition  to  tho  ouri*cnt  a°  (when  a^  repLneoa  but  the  root  of  tho  tableau 
.1.8  not  yot  updated),  (o)  a^*  is  lex  largos  than  for  all  ciorently 
lox  poiitivo  a^  (1  >1),  and  (d)  each  lex  uogative  a^  othor  than  tho  cn^  that 

0  _  —V  V 

vas  a  'hefox'o  a  roplacod  a  will  ronmin  lox  negative  after  tho  iteration  of 

Stop  4  lo  cojiplotod  and  tho  tabi.oau  lo  U|xl'ited  at  Stop  3-  So  long  as 

thooQ  r.utuilJ.3r  Intcrrhjpondont  coniJ.tiona  obtain  m  eholX  also  hoMO  1;/  Theoremo  1, 
and  their  ac.^ompanylng  remarks 

2  and  .‘)/thnt  all  a'*'  that  arc  lox  poaltd.vo  at  the  oxxi  of  Stop  4  trill  bo  lox 
fnillcr  than  ~  and  honoo  that  tho  new  «i  determined  at  tho  rtart  cf  tho 

roxt  J’-.crr.tlon  at  Stop  4  ^rill  bo  lex  aMallor  than  the  jiro'/iouc.  a^.  Since 

V 

tho  vc:tcrr.  ore  changed  by  integer  amount t>,  tho  n  vocioro  cannot  to 

indefinitely  decreased  lexicographically  in  the  indicated  components  and 
remain  lex  positive.  Moreover,  by  Theorem  2  (and  Remark  3)  the  first 
nonzero  component  of  the  old  a^  must  be  larger  than  the  corresponding 
component  in  the  new  a'^.  Thus,  eventually  all  a^  for  i  >  1  must  be  made 
lex  negative.  (The  fact  that  the  tableau  rows  are  linearly  Independent 

V 

assures  that  there  will  only  be  one  vector  qualifying  for  a  at  any  given 
time,  and  hence  that  none  of  the  a^  will  be  reduced  to  the  zero  vector.) 

Tlio  lant  part  of  the  foregoing  proof  may  alternately  bo  esta’oHobod 
by  obncrvJiig  that  0  >  on  each  vioit  to  Stop  4,  and  honc^>  that 

the  aro  otoadily  boing  incroaned  (in  ijitegor  amounts)  toward  0  by  the 
inoroaMing  value  of  -  (equal  to  tho  procoding  S"^).  Fut  since  condition 


(a)  of  the  foregoing  proof  muot  hold  at  each  iteration,  none  of  the  a^  for 
lox  pooitlvo  can  actually  reach  0,  and  honce  ovontually  all  a^  muet 
becano  lox  negative  • 


Theorem  5,.  On  each  vlolt  to  Step  I,  the  o**  vector  vlll  bo  lex  larger 
than  on  tho  piroviouo  vlolt.  Moroovor,  tho  amount  of  the  Increnoo 
vflH  be  at  leact  ao  largo  ns  that  rooultlng  from  pivoting  on  coluain  r 
by  tho  inilee  of  tho  o implex  method. 


Romai  .  In  proving  Theorem  5  v-o  vlll  lot  a°,  a®*,  a^,  and  a°  dorote 


the  indicated  roctore  ae  they  are  doflnotl  ^;hon  applying  Stop  2.  In  addition, 

for  cich  iteration  h  (h  >  0)  at  Stop  4,  1‘it  denote  the  currort  < 

denoto  tho  current  a  vector,  denote  tho  current  a  *,  ard 

p. denote  tho  current  n  ,  Thus,  if  a  denoteo  tho  final  a  vector  after 

lu*  vr 

the  laot  iteration  of  Stop  4,  wo  lay  write 

(5) 


**o  •"©  <r“ 

a  -  a  -  ^  ,  and 

h 


(6) 


r« 

a 


or 


or 


-  £ 


Kp> 


h^'hr  • 


Rcmnrh  J.  By  tho  definition  of  a”*,  a"  will  bo  the  pivot  row  vhen  pivoting 

on  column  r  with  the  simplex  method.  Also,  tho  vector  to  replace  a®  by  the 

oimplex  piv’otli?g  miles  io  a°  -  We  note  that  thlo  rocults  in  a 

lex  lTicj*oa3(j  in  a®  oinco  a  >0  and  a°-»  la  lox  negative. 

or 

P)*co^  oJ’  Theorem  To  provo  tho  theorem  wo  must  show,  hy  the 
foregoing  zromarko,  that  lo  lox  greater  tlvm  or  equal  to 
Since  <  0,  from  (6)  wo  obtoln 

(7)  2  Vhp- 


By  the  definition  of  and  m  also  have 
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Ao  olicfwn  In  tho  proof  of  Thoorea  U,  buccoobIvo  rBappllcatlons  of  Theorewo  1 

nnd  3  Inply  that  la  lex  lar/jer  than  a"*  for  each  h.  Since  ^  0 

and  >  0.  It  foUowa  ri*ooi  (S)  that  Z  1b  lax  loaa  than  or 

equal  to  'L  Alao,  alnce  a°*  la  lax  no/^jatlve,  vo  have  by  (7) 

that  E  la  lox  looa  than  or  equal  to  a^^a***.  Thuo,  from  aquation  (5) 

ccnclndo  that  lo  lax  greater  tlmn  or  equal  to  iT  -  a  a***. 

Finally,  using  the  fact  that  a  a***  -  a*,  tho  doflnltlona  of  T.  '  and  a  ^ 

ar  o  or 

slold  e®  -  a  a**  -  a°  -  a  a°*.  Thlo  pxrovoo  the  t>ieorcm. 

or  or 

Tliojo^^ja  6.  Tho  method  ajeclflcd  in  Section  U  will  obtain  an  optlroal 
Bolutlon  in  a  finite  number  of  otepa  for  any  problem  that  haa  a 
nonempty  oolutlon  aot  and  that  eatlefloa  the  asoumptlono  of  S<ictlon  2. 
Proof  of  Theorem  6.  The  proof  la  Ixanediate  from  Gomory'o  com'orgonco 
proof  for  tho  all-intogor  integer  programming  algor: .tlxm  applied  to  tho  results 
of  tho  foregoing  thoor^ma. 

6,  F/:amr.-le  Problcmo  nnd  Cemnenta. 

Ho  aolvo  three  example  pi'oblemo  in  thlo  aactlon  to  illuctrate  various 
aapects  of  the  method  of  Section  4.  Tho  firat  prbblaa  preaentr.  a  otralght- 
fonfsrd  Application.  Tho  eocond  problem  io  Included  to  illueti-ate  hov  the 
problem  nay  be  oolved  boforo  dual  feasibility  la  rootorod  at  Str.p  4.  The 
moonr  for  x>3Cogni7.ing  when  a  problon  hao  boon  "prauxturely"  rolvod  loads 
to  the  cons jjdox*at ion  of  other  methods  baaed  on  tho  xrosulta  of  Section  5» 
which  wo  also  diecuca.  Finally,  the  thiixi  pxxxblom  daplcto  a  tj;o  of 
nltuoMon  in  wlilch  tho  method  of  Section  4  oxporioncoo  oubatantial  difficulty 
in  re>’'torlng  dtxal  fcaoiblllty  at  Step  4*  Tho  implicationo  of  this  behavior 
In  temp  of  matching  trannfonnationo  to  problem  atructuxro  ara  conaiderod 
briefly  iri  tho  concluding  roraarka. 
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E)mmplo  Problrm  1. 


Minimize  23wj^ 

+ 

17Wj  + 

3w^  + 

B.t.  27w^ 

+ 

20*2  + 

l6w^  + 

17*-,^ 

> 

128 

22w^ 

+ 

1A*2  - 

9*3  - 

> 

45 

“l'  ''2'  “3'  "u  ^  ° 

Tranolfttlna  thle  into  the  inbloAU  form  of  Section  2,  we  have 


0. 


-23 

27 

22 

1 

0 

0 

0 

20 

U 

0 

1 

0 

0 

Hj 

16 

-9 

0 

0 

1 

0 

_  17__. 

-2 

0 

0 

0 

1 

0 

128 

0 

0 

0 

0 

whore  we  havo  Inocrtod  an  additional  pai*tltion  botvmon  the  A®  and  the  I  matrix. 

by  the  procedure  opoclficd  in  Section  4  wo  oboerve,  boglnninc  with 
Stop  1,  that  a^j  >  0  for  J  1  and  J  ■*  2,  hence  wo  proceed  to  Stop  2. 

V/o  select  for  column  r  at  Stop  2  the  ono  that  containo  the  fowert  pocitl\’o 
conpenonts.^  Thuo,  in  this  inetance,  r  "  2,  ao  indicated  by  the  arix<>;  In 
the  tableau  abovo  pointing  to  cclumn  2.  ?rcm  the  definition  of  a®*  mo  epo 
that  3  “  1  when  r  =*2,  hcnco  the  arrow  pointing  to  row  1.  The  ti'anoformations 
prescribed  at  Stop  2  yield  at  Step  3  tho  new  tableau 


1 

-23 

27 

22 

1 

0 

0 

0 

6 

-7 

~C 

-1 

1 

0 

0 

-3 

16 

-9 

0 

0 

1 

0 

-7 

^7 

-2 

0 

0 

0 

]. 

'-7 

~21 

L£L> 

0 

0 

0 

1,  Cur  choico  horo  io  dictated  by  the  conccpt;ual  franowork  underlying  the 
bound  escalation  method.  For  moro  roflnod  criteria,  oco  [3]. 


2 

In  thiu  tiblfSAU  row  a  hi\o  bocoroo  lex  pooitlve.  Therefore,  with  r 
9tlll  at  2f  vro  prooood  to  Stop  end  appl/  the  Indieatod  tranefomuitlon 
for  y  ■■  2*  Tho  updated  tableau  obtained  at  Step  3  la  then^ 

2. 


None  of  tho  a^  for  1  >  1  le  lox  pooltlve,  and  vo  return  to  Step  1, 
Slnco  “  6l  >  0,  we  proceed  to  Step  2  and  let  r  "  1,  thlo  boln^  tho  only* 
choice.  Now  e  3]  ^7  appl^^lng  Stepa  2  and  3  we  obtain 

3. 


Onco  again  the  upper  tableau  hae  lax  poaltlve  rows.  At  Stop  U  w-e 
dotemlro  that  v  —  4,  thereby  at  Step  3  yielding  tho  tableau 


u 

-17 

-1 

-3 

k 

-1 

0 

3 

-16 

9 

0 

0 

-1 

0 

-9 

23 

-1 

1 

-1 

1 

0 

2 

-6 

•1 

-1 

1 

-1 

3. 

Q/v 

-2 

.dL_ 

1 

0 

0 

-5  1 

-1  2  1-2 

-1 

-/»  11 

2-2  1-2 

-1 

-1  -5 

-3  3  -3  4 

-2 

M  1 

1  -1  1  -1 

n2 

-2  -3. 

-3  0-2  -1 

1.  Thle  tableau  may  aloo  bo  obtained  after  two  pivoto  with  Gomory's  all- 
into^or  nlgoritl»m.  Thoroaftor,  howovor,  the  all-lntogor  method  requl-.'  s  9 
additional  pivot  etopo  bofore  obtaining  the  oolution. 
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All  4  .  4ro  nonposltlTo  for  j  >  1»  honoe  the  problem  la  eolved.  From 
the  laat  m  coroponenta  of  the  optimal  eolutlon  la  oeon  to  bo 

''l  *  ^3  “  \ 

Tho  next  exrunplo  problem  to  he  solved  eontaii.J  onljr  a  olngle 


constraint • 

Exniarle  Problem  2. 


Minimize  3Wj^  h  Sw^  + 

+ 

7w^  +  X3w^ 

s.t,  6w^  +  ISWj  + 

36>»^  + 

23k^  +  41Hj 

> 

398 

W^,  W^,  Wj 

> 

0 

For  convenience  w  will  not  botljor  to  write  down  the  lar.t  flvo 
ooltxone  of  the  tableau  corresponding  to  tho  I  matrix  and  tho  zor-'o  vocl*or., 
but  will  explicitly  repreeont  those  colurrne  only  when  they  ere  changorl  fraa 
their  original  fora.  Thue,  for  the  .'ailtial  tabloau  wo  have 


0. 

-3 

— T" 

-5 

15 

-9 

36 

-7 

23 

.-13__. 

_  /.1__ 

0 

t 


The  orr:)^/8  accompanying  thxi  tablocvu  point  to  column  r  and  row 
SIjicq  8  “  3»  tho  third  column  of  the  original  I  matrix  will  be  modifiod 
by  tho  trannfomiation  ucflned  at  Step  Thus,  In  the  rooulting  tabUKiu 
bolo'./  this  Biodiriod  column  is  included  fc»llo\dng  the  modifiod  columns  0  ar-ul  1, 
and  in  written  above  the  new  column  to  identify  tho  variable  with  uhleh 
the  column  xe  associated. 


At  Step  /i  the  t ran afonnat lone  are  initiated  to  return  the  lex  positive 
roifo  to  3 ox  negativity.  Since  v  •“  1,  the  flrat  column  of  the  original  I  o>r.t:*lx 
wLLl  now  be  changed,  yielding  the  ooluiin  below  in  the  tableau  helaxt, 

Wi 
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4» 


Onoo  agnin  ropoatinj  Step  4  vo  obtain 


'3  \  ''2 


-2 

0 

-1 

0 

-1 

■ 

1  1-2 

-1  -2  3 

0  2-1 

0  1-2 

-1  -1  0 

102  -4 

-11  -1  0 

The  problem  ie  now  8olvcc\,  and  an  optimal  solution  la  given  bj 

"1,  *^2  *  '*3  “  \  "0,  ^^5  " 

For  the  procodlng  probl«r,  wo  note  that  the  optimal  solution  x.mb 

alrend/  given  in  Tableau  2.  Since  oome  of  the  a^,^  for  1  >  1  wore  pooitivo, 

howovor,  the  solution  vae  not  identified  ae  optimal  at  that  point.  It 

woulxl  luivo  boon  possible  to  mako  this  Idontificationy  however^  in  tho 

foUofing  vny. 

Wo  ohall  create  a  new  row  from  a^  (v  "  2)  in  Tablt^tu  2  by  dividing 
a'^  thaTJUgh  by  -  a^^  (  “  -  4)r^  and  then  add  thia  new  jtw  to  tho  tabl’jau 

by  inserting  It  above  tho  othero.  Since  tho  variable  aecociatod  vrlth  thlo 
i*ow  (call  it  a)  must  bo  aero  in  the  final  solution,  wo  aloo  adjoin  tho  t-/o 
constraints  -  »-  >  0  and  z  >  0  at  the  end  of  the  tableau..  CarrjrLi\o; 
out  this  procedvjna  relative  to  Tableau  2,  we  obtain 


1. 


V 

a  . 


If  a 


V) 


0,  wo  instead  divide  through  by  the  first  nonzero  ccitipc^  nb  of 


-3  -*  * 

2A. 


T 

The  noxf  top  row  and  the  non*  colnmao  are  eei^ro^rntrd  by  the  added 

partitions.  It  le  evident  by  its  conoti*uction  that  the  new  row  nuat  qualify 
1 

as  a  at  Stop  i».  Thus  the  method  may  bs  applied  by  prc<eeedine  from  Tableau  2A 
instead  of  froa  Tableau  2. 

It  is  unnocoseaiy  to  carry  out  the  computations  In  order  to  pr«idict 
two  things  about  the  a^  that  will  be  defined  at  Step  4.  First,  slrce  thr 
flrct  coTtpjnnnt  of  the  new  row  is  '-1  and  the  conipcnents  of  ccJ-irmii  0 

aro  tntorera,  '  we  may  predict  tliat  a^^  "  0  for  r.U.  lex  positive  (i  /  O). 
Thie  fol3o'«f9  from  the  results  of  the  px'oecding  section,  vhich  assure  that 

all  lex  positive  a^  will  be  lex  smaller  than  -  a'^,  and  that  the  first 

**v 

nonzero  component  of  -a  will  be  larger  than  the  corresponding  component 
of  the  lex  positive  a^. 

The  second  thing  to  be  obnorved  Is  that,  lii  tlie  present  case, 

<  a  _/a  >  "  0  (for  a  ^  -4  and  -  2l/4))>  and  bonce  a**  *•  a“.. 

oiT  VP  or  vr 

This  fact  and  the  one  Juot  established  ascur?  tlmt  the  feasible  eolutior. 
given  by  tlie  bottexn  row  of  Tableau  2  (and  2A)  must  aloo  be  optimal.  Lt 
wo  heve  cotablishod  that  <  “  0  is  a  sufficient  condition  fer 


1.  Concop^;ually,  >:o  may  imagine  thnt  thj  negative  of  the  new  vcni  tn.r»  ad^ciuoj 
at  Stop  3#  whoroupon  thin  row  rotild  rorrsopend  by  definition  to  ^  cX  Step  4 . 
More  gonrr.iliy,  of  course,. >ro  majr  adjoin  any  lox  nogntive  row  \n  ^tc>  t!i'n)U’;' 
an  tlie  now  ouch  that  is  lex  emaller  than  the  current  a'*  ard  lux  lar-'ca* 
than  tlio  current,  a  . 

2.  V  p^n'JLttlng  ratioaal  niimtero  in  the  tableau,  it  sufficor.  mor.'o  gciua  : j.ly  {.o 
Boler.t  the  firet  ccraponcnt  a  of  the  adjoined  row  to  be  -  lA’,  V'bert  Kx, ,  l/i 
fill  Ir.tcf.cr  for  .ill  i  and  J.  °If  column  0  alroady  consirts  of  nonpositlix'^ 


compononts,  then  0»  0*“*  ratarkn  have  rofci’oncc  instead  to  tho  firnt 

coluiin  J  such  that  a  .  y  0.  T©  domonotr/ito  that  a  foa3lb'*.e  solution  in  opbiml, 
however,  conoid  srition'^may  bo  limited  as  above  to  colvann  0. 
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a  foaolble  eolubion  to  bo  optlmalf  whore  la  detennlnod  as  outlined  above 
(but  jiot  by  roforonco  to  the  unexpnndod  tableau). 

If  adjoined  rotm  and  columns  are  actually  employed  In  solving  tho 
Iirobl^ffif  and  not  simply  as  a  means  of  checking  for  optimality,  then  It  \d.ll. 
eventually  be  possible  to  restore  the  tableau  to  Its  original  size.  ^  Tills 
approK  h  of  adjoining  rows  may  also  be  used  at  Step  2  to  provent  the  a^ 
from  becomln,!  lex  positive  In  the  first  place.  There  are  clearly  a  number 
of  pwsslble  variations,  and  by  following  the  appropriate  rules  tho  tableau 
need  not  bo  expanded  to  tho  extent  dopjotod  by  our  illustration  oach  t.lmo  a 
new  variable  is  added.  To  Insure  convex-gsnee  It  Is  of  course  necesoaiy  to 
have  oomo  moans  for  assuring  that  the  succession  of  rows  and  columns  added 
to  the  tableau  will  not  be  unending. 

For  our  last  example,  we  now  turn  to  a  vaxy  simple  problem  that. 
lUurtratee  a  situation  In  which  the  method  of  Section  4  encountoi's  cerJIovn 
•difficult/  In  ro-establishlng  dual  feasibility. 

Ex*mplo  Problem  2.» 


Illniip^so 

+  28w2 

s,t. 

+  45w^ 

> 

98 

''l*  ^^2 

> 

0 

-1 

-28 

1 

.  45. 

1 

0 

t'8 

0  O 

t 


Tho  next  three  tableaus  are  wi  itton  without  additional  ramoioni.. 


1  ,  Py  ooloctlng  one  or  tho  other  of  the  adjoined  roliimnf  (vhlch  vdll  nl>;a;.'3 
Pc  the  ncf.ati'/o  of  each  other)  «s  column  r,  and  pernlotirg  in  this,  11’  p.eci'sair.r, 
nftei-  thojj*  bottom  row  comiorenta  are  0,  oven'  iially  there-  will  raualn  only 
nno  row  of  the  tableau  with  nonzero  components  In  those  columnr,  at  which  Mjr.o 
tho  Indicated  row  ard  coluims  may  be  dropped.  The  optlrotl  solution  mry  of 
coiippo  bo  obtained  before  this  size  reduction  process  Is  ccoipl.et'Sd . 


28 


1. 

27 

-47* 

1  -1 

••28 

45 

0  1 

-0 _ £L 

-27 

26 

44 

.  -43 

-1  1 

2  -1 

-  -37-- 

0 _ =3 

25 

-26 

msgm 

mBmii 

■■ 

^7— 

'  1 

0 _ =3. 

One  nay  infer  from  the  structure  of  this  problem  that  After  six 
more  stops  wo  will  obtain 


19 

-20 

■ 

m 

fl|||||||eV||H|||HH 

64 

0 

-8  -2 

This  tobleau  gives  an  optimal  solution  b/  the  remarlcn  relating  to 
the  previous  example  problem.  Horover,  to  restore  dual  feutiibilltj  bj  the 
mothorl  of  Section  4  may  project  by  inference  that  20  additional  steps 
are  rociuired,  at  which  point  wo  obtain 


-1 

0 

18 

-17  _ 

-27  1 

28  -1 

0 

-8  -2 

Two  interacting  foatures  of  the  tableau  bequeathed  by  Step  2  appj.?r 
to  have  contributed  to  the  difficulty  encountered  at  Step  4t  (i)  a^  rni 


2V 

2 

a  ■“  woro  noarljr  the  oamo,  rmd  (11)  tho  component e  and  of  tho  vnctor 

3  12 

A  4  -f  a  wore  oanall  In  abooluto  value  relative  to  tho  cormopondlng 

1  2 

conpanonts  of  both  a  and  a  . 

The  extent  to  which  these  feattireo  maj  applj  more  generally  to 
chcractorlce  eltuatlono  in  which  tho  tranufornations  of  Section  I4  nhoild  be 
by]-A83C(l  and  others  employed  In  their  place  is  not  yet  known,  lloi/ovo.-, 
a  number  of  related  conelderatlono  are  evidently  involved  in  dot.on.iinlng 
whfvt  types  of  tranafomiatione  should  be  employed  —  e,g,,  tho  frequency  with 
^ich  atructuree  that  ara  difficult  for  the  method  arlr.e  in  practice  , 
tho  ability  to  predict  the  rerult  of  eovoral  Iteratlonn  of  Stop  A  for  thooo 
difficult  structures «  and  the  availability  of  criteria  for  rootorliv*.  dual 
foanibillty  at  an  earlier  point  than  othorwiso  pomlttrd  by  unintor. 
application  of  Step  A*  Wo  do  not  at  preoont  know  a  olgnlficant  ano\int 
about  theee  oon  eld  orations,  but  can  only  acknowledge  thoir  rulovancc  in 
determining  the  uees  to  which  the  result e  of  the  preceding  sootlona  itaj 
be  put. 
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